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ABSTRACT 

The relationship betweer. salary increases and student- 
ratinqa of teachings effectiveness nas studied using a saE|le of 266 
jpaCTlt? iaeBibers at Kansas S ta%0 U niversity. Three measures of 
teachinq ef f ee tiyeness (gtudeEft progress in raeeting relevant course 
ob1eatiTCs# liking the instructor, and ippreciatioD c£ th€ field of 
study) and two sadar.y criteria (percent and dcllar increase) were 
used^-Se ral nieasures of the tttphasis on the teaching futction were 
tised to deterniine whether this variable Baoderated the relationship ^ 
between salariea arid student ratings. The effect of discipline was 
also exasiined. In general^ there was a oodest but significant 
eorrelation between eatings of teaching ef f ectiveneis and percent 
sa lary inc rea se# Tjie laraic^^ ^ 
~f u nx:iriion~^Tari"'^^^ detirniiiMtr.cf the strength of this 

relationship* Correif^iions. were gensf ally sore proncunced^ in social 
_.s_cie^rice- and humanit^fes than in the sciences* Student motivation was 
hiqhlT^cWreia^ed' w^^^ ratings, but ^as not regularly/ 

taken into account/in aalary recommandations* (Author/LBB) 
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ABSTRACT 

The relationship between salary increases and student ratings of 
teaching effectiveness was studied for a sample of 266 faculty meinbers 
at Kansas State University* Three measures of teaching effectiveness" 
(student progress In meeting relevant course objectives, 1 1 king the 
■instructor 5 and appreciation of the field of study) an'd two salary 
criteriartpercent and dollar inCT^ease) WRre used. .Several measures, 
of the emphasis on the teaching function were used to determine If 
this- variable moderated the relationship between salaries and student 
ratings/ The effect of disclpl ine was also examined. 

In general, there' was a modest but significant correlation 
between ratings of teaching effectiveness and percent salary Increase. 
The amount of emphasis given to the teaching function was a significant 
detemilnant of the strength of this relationship. Correlat-1ons were 
generally more pronounced in social science and humanities than In the 
science areas/ Student motivation was-hi^hly correlated. with ef= 
fectiveness ratings* but was not regularly taken into account in salary 
recoiTfiiendations, 
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SALARY INCREASES AND TEACHING EFFECTIVENESS: 



A REPLICATION AND EXPANSION 
Donald P. Hoyt and Jeffrey G, Reed 

Shrinking enrollments at many instituti ons* increasing deniarids for 
accountability and relevance, gradual constriction of funding sources 
for higher educations and other factors have generated considerable 
Jnterest in the evaluation of the performance of faculty members. 
(Hoyt, 1974a) Teaching evaluation by students has increasingly become a 
feature of college campuses, and is frequently mentioned as one basis 
for making decisions about salary , tenure^ and promotion. Despite this, 
a common student perception 1s that their Tatings^ a not taken seriously 
aM that good teaching 1s simply .not rewarded. 

Relatively little empirical data are available to either confirm or 
dispute the allegation that teaching effectiveness 1s not reflected In 
salary recomniendations. At Kansas Stpte University^ Hoyt (1974a) found 
that faculty members whose students reacted favorably to their Instruction 
received^ over tirne, higher salary increments than those rated as less 
effective, but the, co,rrelation between average saTary increment and 
teaching effectiveness was only +.20- In a subsequent studys Hoyt 
(1974b) showed that, after the faculty evaluation process became formal izedi 
the reiatiohship between salary Increments and teaching effectiveness 
(as rated by,jStuderits.) InGreased. The relationship was stronger in the 
social --behavibral sciences than in the natural -matheinatlcal sciences* 
Katz (1973) found no relationship between student ratings of instructional 
effectiveness and salary adjustments at the University of Illinoi's; and . 
similar results were reported, for economists at the University of 
Wisconsin (Siegfried and Whites 1973). Koch and Chlzmar (1973), however, 
found a summary rating of teaching effectiveness positively related 'to 
recommended salary Increments , and more predictive of such increrants 
than measures of "scholarly productivity" or "service" at Illincis State 
University. 

Thorne et al (1976) surveyed representative samples of faculty 
members employed in the Oregon System of Higher Education* Regardless 
of discipline* faculty members In the "university" sample preferred to 
be evaluated by student ratings. and -by..the1.r^publ j ca.tl^ record; .for 
particular -disclpl 1nes a few additional formal measures were sqmetln^es 
mentioned* Without exception* these faculty groups objected to^ such 
indices as chairman's judgment- or evaluation by cornmittee If these were 
not based on systematically collected data. Respondents also resisted 
informal colleague ratings, time in rank, and pub! 1c pfesentatlons as a 
basis for evaluation. Keene's (1975) report of a correlation of ,40 
betv/efen recormiftended salary increment and teaching effectiveness as 
judged by the chairman may reflect the type of "halo" error which the 
^Oregon faculty apparently suspected* ; 



McKeachie and Lin (1 975) conducted the onl>^ experiniant which has 
been reported 1n the literature. They used 20 senior University of 
Michigan faculty meinbers, all of whom had served on promotion and .tenure 
cofninittees, to Judge the promotabil i ty of "hypothetlcaV facult^^ mfembers. 
Faculty and student estimates of teaching ab1l ity, research productivity, 
sex, and academic department of the^cases were varied systematicanyJ 
Judges were asked to make decisions on promotion and salary increase 
recommendations. Much more emphasis was placed on research productivity 
than on teaching ability, and there was "1 ittle evidence that 1nforfnat1on 
from student ratings of teaching is utilized when decisions; regarding 
promotions and salaries are made" (McKeachie and Lin, 19755 p\21). 

Although the data are not conclusives two general hypotheses emerge 
from the literacure. (1) The degree to which objective measCires of 
teaching effectiveness relate to salary adjustments is a dlrict function 
of the degree to which the teaching function 1s emphasized. (2) The 
relationship between these two variables differs among various academic 
disciplines. 

The present Investigation was designed to explore these hypotheses 
for a sample of Kansas State University faculty members* 



Faculty members were Included in the study if they had; 

(a) ^ vol untarlly participated in the KSU "student evaluation of 

instruction" program during 1974-1975 (Hoyt, 1973; CFE & DHE, 
1975); and- 

(b) completed the "Faculty Survey for State Colleges and 
Universities of KansaSp Fall 1974" (herein called: Activity 
Survey) (Kansas^ State Board of Regents^ 1975). ' 

Graduate teaching assistants and faculty members who were not reap- 
pointed for the 1975-76 year were excluded from the study, A total of 
266 faculty members met these requirements. 

Subsamples = 

To explore the hypotheses, It was necessary 'to divide the sample 
into subgroups according to discipline and according to emphasis on 
teaching as a professional activity. In the earlier study^ Hoyt (1974b) 
used only two broad groupings (natural-mathematicaT scientists and 
social-behavioral scientists). This study retained those broad group- 
ings and created a third, Humanities and Arts. In addition* rnore 
homogenous groups were constructed as follows: 



PROCEDURES 




1. Social SclenceSi Including history (N-20). 
2, , Humanities and Fine Arts (N*24). 

3. Applied Sciences (Agricul tuJ^e^ Engineering, Foods a 

Nutt^ltion, Veterinary Medicine) (N=55). 

4. Appl led Social Sciences (Education, Business/ Speech 

? Pathology and Audldlogys Famny and Child Deyel opfnents 

Institutional Managementj Regional and Coifimuriity 
Planning, Family Economics) (N=79). \ 

5. Applied Arts (Architecture and Design, Mass Commuhlcatlons 

.and Journal ism, Clothing, Textiles & Interior 
Design) (N=2S). 

6* Natural Sciences (Biological Sciences ^ Physical Sciences , 
Psychology* Plant Pathology, Entomology, Grain Science) 
(N^44). ■ 

7, Mathematical Sciences (Mathematics, Statistics, Computer 
Sciencei Applied Mechanics) (N=19). 

To distinguish among faculty members who differed in the emphasis 
given to the teaching functionj several .special subgroups were formed. 
These are described below: 

1. Academic Rank. Many non'teaching responsibilities are traditional 
ly ful filled by experienced and "proven" faculty rnembers (service on 
important committees or on Faculty Senate, leadership in professional 
associatlonSi writing/executing grants and contracts, etc.)* Consequently, 
faculty members with low ranks give relatively more emphasis to teaching 
than do those with senior ranks. Therefore, the expectation was that 

the correlation between salary increments and student ratings of teaching 
effectiveness would be higher for the former than for the latter. 

2. Departme ntal Program. Presumablyj departments offering the 
Ph.D, will need to give a special emphasis to research; therefore, 
relatively speaklngi their emphasis on teaching was expected to be less 
than for departments which did not award the Ph*D. 

3. Teaching Emphasis in Workload. The Activity Survey asked faculty 
members to estiiriate^e average number of hours they spent each week in 

a variety of teaching and non-teaching activities* From these reports, 
two ratios were derived, as follows: 

.a. Ratio- A = DTA 

(Direct^ Teaching) DTA + OT^^RSC + ISA> EGPS^_ ' 

b. RatiO"B= DTA + OTA 

(All Teaching) DTA + OTA + RSC + ISA + EGPS 

" The component parts of the above equations are: , 

DTA (Direct Teaching Activities): number of hours meeting with 
classeSi reading student papers, supervising laboratories^ 
evaluating studentSp preparing lectures; etc, 
OTA (Other Teaching Activities): number of hours of unscheduled 
v " teaching, academic advisings course an^.curricul urn development, etc. 
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RSC (Researchp Scholarship, & Creative Activities): number 
of hours devoted to funded and non«funded researchs giving 
recitals, editing a journal,, reviewing work of coneagues, 
writing , articles, etc. 

ISA (Internal Service Activities):" number of hours in student- 
oriented activities such as recruiting students ^ writing 
reconiTTiendations, sponsoring student organizations; attending 
recitals; administrative duties such as writing reports^ ^ 
preparing budgetsi recruiting faculty^ administering research 
grants; academic and professional support services for library 
or computer center; conimittee participation* 

EG^ (Externrl and General Professional Service): number of hours 
in Agriculture and Home Economics Extensioni Continuing Educa- 
tion oveH^Md^ teaching, consulting, public lectures, other 
professional services. 

It was expected that salary increments for faculty members with 
high ratios (high emphasis' on tiaching) would be more closely related to 
student ratings of instruction than would be the case for those with low 
ratios. " ' > 

Measures 

Data collected for each subject were the same as those In the 
earlier KSU study (Hoyt^ 1974b), In addition, an estimate of student 
motivation was included. These measures are identified below* 

1. Student Ratings. ^ Of the several specific ratings made by 
students I three wer^e selected as overall measures of teaching 
effectiveness* 

a. Progress on relevant objectives. From a list of 10 
bbjectivess instructors identified those which were 
"essential-', '^'Important*', or "of no more than minor 
importance'' for the course in .question. Students 
rated their progress on these same objectives, using 
a five-point rating scale. Average ^student progress 
ratings were weighted by the Instructor's ratings of 
importance ("essentiaV - 2; "important'' = 1; ''^of ^o 
more than minor importance" = 0), and the weightedX 
average (Progress on relevant objectives) was used — 
as the first measure of overall teaching effectiveness, 
b* Liking the Instructor. The average response to the item,# 
■'I would like to take another course from this instructor'%^ 
^ was used as a measure of overall Instructor desirability. 
A five-point rating scale was employed, 
c. Appreciating, the Field of Study, The average ^sponse to, 
"As a result of taking this course, I have more positive 
. feelings toward this fieli.of study", was used as a ' 
third estimate of teaching effectiveness. Again, a 
five-poiht scale was employed. 
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d. Studenc^MotiyatiQn, The average response to. .the IteiTi, 
"r had a strong desire to take this course's was used 
to obtain an estimate of student motivation on a fiye-polnt 
scale. This measure has been shown to be related to the 
three overall criterion measures* Unless its Influence was 
removed (statistically), correlations' with salary recom- 
mendations may reflect the particular courses assigned 
rather than teaching effectiveness per ..se. 

In most Instancesi student ratings were available for more than one 
course during the semester in question (Fall, 1974-75). An average of 
all such .ratings was used. 

2, Salary Recommendations > Two salary measures were used: dollar 
increase, and percent increase. This information was obtained from 
the official University budget for 1975-1976. 

Analyses ' ■ 

Product moment correlations were computed between each of the three 
measures of teaching effectiveness and the two measures of salary recom- 
mendations. Partial correlatlonsi controlling for the effect of the 
motivation measure, were also computed. ' ' 

Comparisons were made among the seven types of disciplines as well 
as among groups defined by academic ranks highest degree granted, teach- 
ing emphasis (Ratio-As Ratio-B), and a collapsed grouping of academic 
discipl iTies. 

RESULTS 

Descriptive statistics for the sample and subgroups are shown in " 
Table 1 . ^ 

Ov erall Correlatlo ^ns ^ 

T' 

The correlation 'matrix for the total sample (N - 266) Is presented 
in Table 2* along with partial correlations (student motivation controned)* 
The two criteria (dollar increase and percent increase) were significantly 
correlated (*65) as were the three measures of teaching effectiveness 
(,^74 - .86)* As expected, motivation was correlated highly_w1_th_ ef- 
fectlveness ratings (.56 = .72)* . 

INSERT TABLES 1 AND 2 HERE 

All three measures of effectiveness (and the student motlvaUon 
mepsure) were significantly relatedY.to '-percent increase's but the 
magnitude of these relationships was' loW (.16 .22). Only one cor- : 
related significantly with "dollar Increase", this 1s not surprising^ ^ - 
since official .University policy has bean to reflict judgments of merit 
in "percent'- rather than dollar increases, ' - H 
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OVERALL ^DESCRIPTIVE SfATISTICS FOR THE VacULTY SAMPLE 
(N - 266), ■ ^ 



I . Academic _Rank 



Frequency 
Percent 



Instructor 

16 
5 



Assistant Prof. 

lOS 
40 



Associate Prof." ^ 
34 ^ 



21 ^ 



IL Academic Area 



Sciences Fine Arts 



Frequency 
Percent 



Social ' Humanities' AgflcuUure .Education Archltacture 
Engineering Business Design 

Vet.Med^'cine ' SpchiPath- 

/5S 79 - 

/ 21 30 



20 
8 



24 
9 



III. Highest Dag 



t Degree grante_d_by the Depart^^ 



egarttfe nt of which a' Member 
Ph.D. 



Frequency 
Percent 



162 
61 



Masj,, Cgninun . 

25 
9 



Other 

104 

39 



fiathefnatics 
Science ^ Sta^tf sties 
_ Compute Scli ' 



44 ^ 

16 %^ ^ 



19 
^ 7 



IV. Overall Statistics q;i Criterldn and Prgdjctor Variables ' 

^ Meaf 

A/^ Percent Salary Increasa ^ 10,70 

S. Dollar Salary Increase 1642.20 

^ Student Ratings of erograss In Meetlfig < 

" Course Objectives > 3,71 

D. . Studept Rating of Liking Instructor 3*86 

I. ■ Student Rating of Liking Field ' 3,91=. 

F. Student Rating of Self Motivation 3.65 



Standard Deyiation 
2,39 
454.51 

.44 - 

rn 

.60 " 



V, Re_la_t i_ve_ Emph a 5.1 s_ o_n_ tf a.c hi n g Ac 1 1 vi 1 1 eg 



A. Direct teachjng ^.ct1vit1is 

P e nee n t T — ~ 

B. All Teaching , Activities 

Frequa^cy^ 
Pereent 



Low 



5^ 



4S 
17 



Time Groupjnp 
Mode'rite 



161 
60 



146 

.55 



High 



47 
18 



71 
27 
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TABLE i 

OVERALL CORRELATIONS BETWEEN PREDICTOR AND CRITERION VARIABLES 



Zero Order Correlations 



% Salary 
Increase 

$ Salary 
Increase 

Progress 
Rating 

Liked 

Instructor 

Liked 

Field 



$ Salary 
increase 



,65*** 



Progress 
Ratlrijg 

.16** 

. .02 



Liked 
Instructor 



Liked 
Field 



.08- 



.22*** 



,13^ 



Motivation ' 
Self Rating 



■^^^ .74 



*** 



,81*** 



Partial Correlations (Controlling for Motivation) 

■ Progress Rating 
I Sal ary Increase ,07 
, ' : $ Sal ary Increase ,. -.03 



„ .86 



*** 



Liked InstructQr 
,13* 
-,05 



.16 



,07 



I 

.66*** I 
^ • 
I 
I 

, 56*** J 

I 
I 

- I 
I 



Liked Field 
.15* . 
■ .12 



Significarice Leyels for Correlations (one-tai led JestsJ 



p < .025 
p ' < .005 
P,' < .001' 
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To determine If the relationship between salary and effectivriess 
nieasures would ba affected by controlling for student motlyation, 
partial correlations were coniputed.^ Table 2 shows thats when this was 
done, the correlations were significantly reduced. Only two of the six 
v/ere statistically significant/ and they were too low to be, practical ly 
meaningful (.13 and ,15). 

Academic Area ' 

Mean values and correlations between salary Increase and teaching 
effectiveness variabTes for each of seven academic area sub-groups are 
shown in Table 3. Correlational data followed several basic patterns. ^ 
Moderately strong zero order correlations were found for Social Sciences s 
Humanities and Fine Arts, Applied Social Sdencess and Applied Arts 
(groups As D, and E); but zero prder correlations were non-significant 
for Applied Sciences^ Natural Sciences, and Mathematical Sciences (groups 

F, and G) , ^ The effect of controlling for motivation through partial 
correlations pcodiiced different' results for different groups. For 
Applied Social Sclenaes and Applied Arts, partial correlations were very 
similar to zero order correlations (groups D and E). For the Humanities 
and Fine Arts group', "howeverj partlalling out the effect of student 
motivation reduced significant correlations (ranging from +J'3S to +.54), ' 
to zero, Surprisfngly, in the Soda! Sciences, moderate zero order 
correlations (ranging from +.24 to +.35)j were increased (+,3T to +-59) 
when .motivation was partial led out/ In the Applied Sciences, Natural 
Sciences, and Mathematical Sciences subsamples (groups C, and G), 
neither the zero order nor the .partial correlations differed significantly 
from zero* | ' ■ 

INSERT TABLES 3 AND 4 HERE 

To increase cbmparabll ity with an earlier study. (Hpyt/ 1 974b) ^ 
disciplines Were^ grouped Into three brttad areas --^ Natural and ilatheniatical 
Sciences (Applied SclenceSi Natural Sciences, and Natheniatics)^ Social- 
Behavioral Sciences (Social Sciences arid Applied Social Sciences), and 
Humanit1es-F1ne 4^t^ (Humanities, F1ne;Arts, and Applied Arts). Mean 
values and correlations are reported In Table 4. Significant zero orde^. 
correlations were obtained for only the J astDtwo^ogi^oups; there was no ^ 
.relationship between Salary Increases and teaching effectiveness yariables 
, for the Natural --Mathematical Sciences group* When motivation was controlledi 
the magnitude of the relationships was significantly reduced ^for the . ^ , 
Humanities-Fine Arts; fp-r the Soclal-^Behavlpral Sciences, the partlal^^ 
correlations \yere not much lowar thaji the zero order cofrelations. 

The remaining analyses.- examined predictor/criterion relationships, i^^,. , 
for groups believed to differ in terms^df the emphasis given to teach1hg-\ 

Academic Rjf^k^ ' "-^ '^^'^^ ' . . ' ^ 

- • Mean values and colrrelatlons for each ,of the four acadeDic ranks 
are shown In Table 5, Consistent with eK^pac^ationSi zero "order cor- 
reUyons between salary-Increases and teaching effectiveness were. 
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■ TABLE 3 

TEACHING IFFECTr VENESS kHO SkUW IHCREASES: 
COMPARISON OF FACULTY MEMBERS lf4 01 FFERENT MAEHIC kktkS 



1: ' 

..!, Mean Vjl ues for 7 A_c_ademic_ Amt 



Htiitiariiti^s 
Applf edVSci. 
A^pl. Soc, Sci, 
Applied ^rt/. 
Nat/ Sc lances 
Math, Seleneas 





$ Salary 


^ Sal ary 




LlNid 








Incraasa ^ 


^ Incf&ase 




I ns true tor 




Self -Rating 


20 


1533»65 


10. 73 




^ 3.57 




*3J7 


24 


1318,12 


10. 37 ^- 




4.09 


3/99 


'3^11 . 


55 


1840.53 


10. M 


2,73 


3-90 . 


^^41 03 


3Jl • 


79 . 


1551.76 


10. 6^ 


hm 


4.05 


4,LQ 




25 


1621.24 . 


11. 10 




3.68 


3.79^ 




44 ^ 


1754.48 


10.46 


3.se ^ 


3-68 


- 3, fir 




19 


1735.26 




3.BS 


3,68 


3.57 





SoC'lal' Sciences 

Progress Rating 
Liked In it rye tor 
Likad Field 

WumanltljSj^^IhgArti, 
~ Progfiii" Rating^' 
Liked Instryctor 
Liked Field 



Percent 



- ^27 
^28 



^38* 
. 51** 




D<illsr 



*24 

' .35^ 



^54*** 



Percent 



.45* 
.39* 



Dollar 



.36 



.01 

.09 



' Progress Rating " .^"oT ~ ~ ^JT5S^ . " " ^ 



Liked Instructor 
Liked Field 



.07 
^16 



.05.> 



10 
-,09 
03 



.03 
*03 



-ai 
.0? 



Ap;g Ijg d jo^la^l _ S c i_e n ca s : _Ed_u catT oii B us i n eiL S pc ^ . Pj t fi . & _Au 4. . F . C J * t_ X Cg^ jlarinlrti 
PrDgresi Rating f ^ r2l* .13 ^'^^"""^^"^'""^ 

Liked Instructor ' .30*** ^30^** ' .25**^ .19*-* 

Liked Field ^ * 27** . ^^4^ .2L* .23^* 



A£glJ|d_Art|j_Archita^ 

^rograss Rating ^ ; 35* """^W^"^'^ " " .3^*"'^^ ""^^"T^ 

.31 ..33 . ,3L .3?^ 

. 34* ■ ^33 .34 .38* 



Liked Instructor 
Likid Field 



F, Naturil^^clincesjSc^enc^^ 



Progress Rating 
Liked Instructor 
Liked Field 



07 
10 



-.03 
.08 



,05 
.08 



-At 



Mithjinatlcal Scljncesx HathenntlcSj S titlstlis^^COTUtef Scjenci 



Trogriii Rating" 
Liked Instructor 
LiketiTleld 



,14 




Sifltnif leanee Lgyels fpr jorrelitl^ (pnj-talled test-s) 



if 

** . 
*** 



P \ 



.005, 
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TABLE 4 

TEACHING EFFECTIVlNiSS AND SALARY INCREASIS: 
COMPARISON OF FACULTY- IN RELATED ACADEMIC AREAS 



Mean Values for Combined Acidemic Areas 



AppTled Sciences i 
Natural Sc1&nces, 
I Mathematics 



Number 



118 



S Salary^ 
Increase 



1791.49 



% Salary' 
Increase 



10^7 



Progress 
Rating 



3* 64 



Liked. 
Instructor 



3.78 



Liked 
Fiald 



3,83 



Motivation 
Self Rating 



3,59 



Social ScianciSi Si \; 
Applttd _So.(i^ci . 99 


1548*10 


10,66 


3.79 


3.96 


4.02 


3,67 


Humanities, Fine Arts* 
h Applied Arts . 49 


1472.78 


/' 10,74 


3,73 = 


3.88 


3.88 


3,73 


Correlations (Zero Order and Partial Lbi 


/ ^ 
Cpmbined 


AcadaiTiie jArea 








\ 


1 






PaHiai 


Correlations 





Zero Order Corralations 



Percent 
Incraiie 



Do! Tar 
Increase 



A* Applied Sciencai^ Naturll S^Lltncjjj i^atbgf ng^^ 



Progress Rating 
Liked Instructor 
Liked Field 



.^7 
.08 
.14 



-.03 
-,06 
.08 



B. ' Sgc 1 a 1 Sc 1 enc es_ i _S . Appl^lgd jpcj j j^St lencjj 



Progress ^Rating 
Liked Instructor 
Liked Field 



as* 



Humanities, Fine A rts, % Applied Arts 



Progress Rating 
Liked Instructor 
Liked Field 



.34** 
,29** 
.37*** 



.13 

JO*** 
.24** 



.21 ^ 

.21 

.29** 



Percent 
Increase 



-,03 
.01 
.08 



.13 

.25** 

,21** 



/ 



,22 
.17 
.24 



DQllar 
Increase 



-^.13 
-,14 
,04 



.10 

, 30*** 
.26** 



,11 
.12 
.20 



gi jn jjlg ancg _L6y e Is f o r C o r r e 1 a t lo n ^ (on e -it ajJ^ed^ ^ stjX 
p < % 05 



** p < .025 
*** p < .005 



positive and high for instructors, positive and low for assistant' and 
associate professorSi and non-significant for fulT professors. Partial 
corVelatlons Were generally small er, but followed the same general 
trend. 

INSERT TABLE 5 HERE 

Degree Qranting Status of the Departnient • 

D8partments---wefe grouped Into Ph. and non-Ph*D, granting departments 
and resuXts-based on this classification are presented 1n Table 6. Both 
zero order correl atlons and partial correlations were higher for non-. 
Ph*D/ granting departments than for Ph.D. granting departrnents, again 
confirming theoretical eKpectaftons, , ^ > . 

INSERT TABLE 6 HERE ^ 

Teaching_ Em phasis of Faculty Menibers 

In Table 7 faculty members were classified on the basis of the 
amount of time they devoted to teaching activities; data are reported 
for three broad groupings (Low, Moderate^ and High Emphasis}. When 
Ratio A (Direct Teaching Activities) was used to classify faculty 
members, correlations between salary data and teaching effectiveness 
ratings were directly related ^^to the amount of emphasis placed on 
teaching*"- the greater the emphasis placed on teaching the higher the 
zero order and partial correlation. For the group with low Emphasis ,on 
Direct Teaching Activities', there was no relationship between salary^ 
increases and teaching effectiveness ratings. ' 

INSERT TABLE 7 HERE 

When All Teaching Activities were considered (Ratio-B), cprrelations 
.for the "High Emphasis" group were even stronger^ butno relationships 
were found for either the ■■moderate'- or '-low" groups, 

DISCUSSION 

Although the sample was large (N^266) and included faculty members 
from all colleges of the Universitys it was not necessarily representa- 
tive. Only those who voluntarily participated in the teaching, evaluation 
program sponsored by the Office , of Educational Resources were included. 
Jhere is some reasori to believe that such vol untears aref on the average* 
somewhat more effective teachers than non-vol unteers. More Importantly^ 
while the purpose of the program 1s-to help faculty members Improve 
their effectiveness, some probably 'sHared results- with their department ' 
head to facilitate the faculty Ivaluation process. ^To the degree that 
this was true, the relationships reported 1n this study between salary 
Increases and objective measures of teaching effectiveness probably 
overestimate the reTatlonship for the entire population. 
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TABLE S 

TEACHING EFFECTIVENESS AND SALARV INCREASES^ 
FACULTY MEMBERS CLASSIFIED BY ACADEMIC RANK 



L Mean Value s for 4 .Faculty Ranks 







S; SaUry 
Iheraase 


% Salary 
Increasi 


Progress _ 


Liked 
Instructor - 


Liked / 
Field 


Motivation 
Self Rating 


Instructor. 


16 


1117.50 


10.64 


3.77 


.3.82 


3,90 


3,67 


Assist, Prof, 


105 


1445.31 


10,63 


3,75 '■ 


3,94 


3i91- 


^ 3^66 ^ 


'Assoc. Pro'f% 


90 


1709,63 

"1 


10,83 


3.74 


^ 3.87 


/ 3.95 


3.70 


Professor 


55 


2660.35- 


10.62 


^3.58 




3,84 


3,55 



II. Correlations (Zero O rder and Pa rtial) by Faculty Rank 

Zero Order. CorreUtlQjis^ 



A. instructors^- 

Progress Rating 
,> X'X^M Instructor 

Liked Field 

"\ 

6 , AjsistihArProff ssor^^^^ ^^^ 

Prograss Riting 
..Likad Instructor 
Liked Field 

Ajs oc_i a t:e_PjrQf as s o r s_ 

Progress Rating 
Liked Instructor 
Liked Field 

professors 



progress Rating 
Liked Instructor 
Liked Field 



Percent 
Incresse 



.55** 
.59** 
.74*** 



.16* 

.22** 

.22** 



as* 

.33***f 
.28*** 



,03 
-.12 
.01 



Dollar 
Incfiise 



,44* 
* 54** 
,66**^ 



,18* 

.21** 

.20** 



.14 

.25** 

.26** 



.00 
-.03 
.00 



Partial C o rre 1 at i on s^ 
(Control l_i naifOL ^ ^ ^^^^ 



Percent 
Increase 



.43 

,50* 

.67*** 



.10 

.17* 

.17* 



.04 

,25** 
.18* 



...04 
= .17 
.01 



Dollar 
Increase 



.33 

,46* 

.61** 



.11 

.16 
.14 



-.03 
.14 
' ,13 



.13 
.06 
,.17 
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r 




.05 
.025 
.005 



le 



n 



■■ • ■ TABLE 6 

TEACHING EFFECTIVENESS AND SALARY .INCREASES:' • - 

FACULTY MEMBERS TN "Ph.D. GMnting Departments" vs. THOSE IN "Non-Ph.D. Granting Departments" 

/"\ : , 1 i' 

Hean Values for _ Faculty by Departfnent Tyge ' « 

^-^^ $ Salary % Salary ' Progress Liked Liked Motivation 

' ^ - N^umber Increase . Increase Rating Instructor Hejd S^ f Rjttjn 

Ph.D. i 162 1684.65 10.49 :'3,70 3.87 3.90 3.59 ; 

■ :Non-Ph,"'D.., 104- 157,6.06 11.02 . , 3.73 3.86 . 3.92 3.74 

, Co^rr^eiations (Zaro Order and Partial) by Degree Offered ^ > v ' 

■ ^ Pai^t l a l Correla tiQns 

. Zero Qrde i^^ Correlations ( Con t ro 1 H ng f o r No 1 1 va 1 1 on ) 

' Percent . Dcbllar Percent ^ :^ Dollar 

Increase Increase ^ Increase Inci^ea'se 

, A, . Ph. D. Departments ^ ^- \ ' 

■ Progress Rating = .10 . -.01 ,03 ? -.14 

Liked Instructor ■ .16** .02 , .11 ' -.07 

. Liked Field .18** .11 ,14* -.02 

B, Non - P h . D . Pe pa rtnie n t s 

Progress Rating .26*** .10 ,17* ' .13 ' . 

Liked Instructor- .27*** .21** < , .19* . .25** 

. Liked Field .30***,' . ^ .18* .22** ■ -.27*** 

, ■ ■, / ' • ■ 

Si gni/ican ce^Lgygl s for Correlations (one-tai Ted tests) ■ 

• / ■ * p~ < .05 / - ' ■ • ■ ' ■ 

/ ..V ' ** p < .025 



*** p < . 005 • / i 



/ 
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TABU 7 

TEACHINGEFFECTIVENESS AND SALARY INCREASES: 
COMPARISON OF FACUaV ON THE BASIS OF RELATIVE EMPHASIS ON TEACHING ACTIVITIES 

I. RATIO-'A (Direct Teaching Activities) 



Low Emphails 
Medium Emphiil 
Higft Emphaiis 



' 3 Rati oj- A Groups Qf_ 


Faculty 


Progress' 
Rating 


Liked 
Instructor 


. Liked 
Field 


Motivation 
Self Rating 


Number 


increase 


% Salary 
Incraase 


54 


1864,15 




3,62 


3.81 


3.84, 


3. 57 




1656,42 


10.73 


3.75 ■ 


3.91 


3,95 


3,65 


47 


1J56.60 


ioao 


3 JO 


3;81 


■ 3*89 


3.78 



Co_r re 1 a t1 0 n s _ ( Ze r 0 _0 rder a nd ■^a_rt:la ]) by Rat lo-A Teaching Imp h ri.iSi_Grp u Pj 
■ ~ » Partial correlations 



Zero O rder gQ^Telatlons, 
- Dollar ^ 



Percent 
Tncreasa 



Increase 



'P^ercent ~ ~ ~ DollaT'"^ 



Increase 



Increase 



Low Eff i phasl5_ 

Progress Rating .04 

Liked Instructor /09 

Liked Field . - .12 



-.06. 
.00 
.06 



,08 
.00 
.03 



-,14 
-.04' 
.03 



Med i uglm^hgj is 

WofremTating .20** 

Liked Instructor .19** 

Liked Field :.22*** 



.08 
.06 

.15* 



,12 
.12 
,15* 



.03 
.02 
.12 



~ "Progress Rating .26* 
Liked' Instructor ,39*** 
Liked Field ' ^ .41*** 



.09 

.27* 

.27^ 



,14 

.29* 

.31**, 



-.03 
.17 



IL RATIQ-B. (All Teaching Activities) - / - 

A% M ean Values for" 3 Ritlo-'B Groups of Faculty ^ . T ' 

i Salary % Salary ^ Progress ' Liked , Liked Morivation 

= Number Increase Increase Rating Instructor Field Self Rating 

Low Emphasis 45 1787.67 / 10.21 3 J5 3.>0 3.74 3,49 

Medium Emphasis 146 in3,38 11,08 3 J3 3-91 . 3,95 3*64- 

High^Emphasis 71 1415,65 10.27 3.78 3.89 3.96 , 3.80 



Corre lations (Zero Order and Partial) by Ratio-B Taachi ng Imphasis Group • 

--^^ — - - - -^'^ ■ N Hartial Correliti 



Percent 
. Increase 



ons 



Zafo Order CorreTatigns, (fan tFo^Tli^^J^flffo t_1 vat i_Q nj 

" DolTar / Percent Dollar 

Increase, Increase Increase 



LQW_Emph_aiji 

' Progriis Rating , J07 

Liked .instructor .22 

Liked f leld .20 



.07 
.11 
.23 



-.06 
,17 
,16 



-.15 
.02 
,10 



Mad i ur n Emphaji s 

Progress ^ati ng 
Liked rnstructor 
Liked field 

Hi^h_|_mgha|i_j_ 

Progris? Rating 
L1k6d Instructor 
Lllied Field 



.12 
.05 
,11 



! 48*** 
. 49*** 



.02 
-.06 
,03 



.19 

.38*** 
.39*** 



,06- 
-,02 
.03 



.17 

.39*** 
,39*** 



.00 
.09 
.01 



.06 

.30*** 
.30*** 



Signlflcanca Levels for Correlations (Qne-talled tests) 



*** 



erIc 



*05 
• 025 
.005 
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Although, results varied among, subgroups , there was generally a 
positive and significant relationship between student ratings of ieaoh- 
ing effectiveness and percent salary Increase. For the tot-^l sample, 
this relationship was very modast (r about .20) i and in most ''science" 
areas It was non-existent (whether these were "app11ed"-areas like^ 
Engineerings Veterinary Medicine^ or Agriculture^ or more ''basic" fields 
in the physical, blologicaU and mathematical areas), In other fields 
of study,' the correlations tended to beM^n the .30 to AO range, 

1 Should they be higher? ^ Possibly, On the averagej if teaching 
constitutes, about eO' percent of the typical faculty mewiber's respflnsi- 
bility^ th&n 60 percent of the merit .evaluation should l^abasfd^on teaching 
o. effectiveness. While student ratings^are only one of the ways such 
effectiveness can be assessed, it ^'seems reasonabl e to allot them about 
50 percent of the weight (leaving 50 percent for other types of Inp.ut or 
judgment). Thus, In toto* student ratings might be eKpected to account 
for about 30 percent'of the total merit evaluation of the' typical faculty 
member (,60 K .50). If this were the case, student ratings would GOrrelate 
" about ,55 (VTTo) with' percent increase. On the basis of this reasoningi^ 

it appears thrt the relationships found In this studjy were "too low"; 
^W,e.j thapstudent input was "undervalued", ' ^ 

On the other hand, one could hardly expect maxlmuin correlations 
given the aonditlons of the study. (T) Student ratings fo^ only one 
semester were used, even though merit increuses were based on a ful>' 
\yearU perforniarice, (2) Only those courses selected for evaluation by 
the faculty rngmber were included, (3) Ther^, was no guarantee that the 
student ratings' were seen .by those responsible for faculty evaluation. 
' Given these limitations, the magnitude of the relationships found appear 
more reasonable, 

' It 1s especially reassuring *to note that relationships were more 
pronounced for faculty members who were most involved in teaching (those 
; of lower r^nks; those teaching in non-Ph,D,. degree .prograiris; those 
spending'the greatest proportion of time ir'teaching). Apparently, 
department heads at KSU have differentiated appropriately among faculty 
members whose prjfessioniil responsibilities differ widely. 

With a few exceptions, when student motivation was statistically 
^controfled, the relationship between student ratings and saUry Increases^, 
'diminished. Thus, there was some evidence that those responsible for 
faculty- evaluation may not have been sensitive to the complexities of 
teaching evaluatloh* It is relatively easy to obtain favorable fatings 
from interested and motivated 'stiJdentsr but apathetic or negative 
students are hard to impress, Apartment heads should take thls^ into 
account in interpreting student ratings. 

Future studies should be modified'by including student ratings'for - 
a full year (rather than one semester), determining what percent of 
courses were rated, and distinguishing between those whose student 
ratings were used 1n the merit evaluation process and those who did' 
not, share results, 
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